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AMENDMENT TO THE CLAIMS 

The following is a detailed listing of all claims that are, or were, in the Application. 
1-29. (Canceled) 

30. (Currently amended) An apparatus for processing multimedia data, the 
apparatus comprising: 
a memory; and 

a processor configured to perform operations comprising: 

receiving segment information about an audio-visual program, the segment 
information identifying a plurality of audio-visual segments in the audio-visual program, 
wherein each audio-visual segment is defined by a temporal position in a multimedia stream 
of the audio-visual program and represents a continuous temporal content portion in the 
audio-visual program; 

generating a hierarchical data structure d e scribing multim e dia data and 
configured to facilitate browsing content in the audio-visual program, the hierarchical data 
structure including the segment information along with segment group information defining 
first and second segment groups, each of the first and second segment groups including 
defining a respective plurality set of audio-visual segments selected from the plurality of 
audio-visual segments identified by the segment information in the [[a]] multimedia stream 
of the audio-visual program , wherein said segment group information specifies a respective 
group type and a respective duration for each of said first and second segment groups, the 
respective group types indicating that the first and second segment groups represent 
respective first and second content summaries related to objects or events as depicted in the 
audio- visual program, and wherein the segment group information includes segment order 
information defining that (i) the audio-visual segments within the first segment group are 
ordered relative to each other according to a time sequence that is significant for the first 
content summary's representation of the corresponding events or objects in the audio-visual 
program and (ii) the audio-visual segments within the second segment group are unord e r e d 
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not ordered relative to each other according to the any time sequence that is significant for 
the second content summary's representation of the corresponding events or objects in the 
audio-visual program ; and 

storing the hierarchical data structure including the segment information along 
with the segment group information in the memory. 

31. (Previously presented) The apparatus of claim 30, wherein said segment 
group information includes a level information. 

32. (Previously presented) The apparatus of claim 31, wherein said level 
information defines multiple levels. 

33. (Currently amended) The apparatus of claim 30, wherein each audio-visual 
segment contained in the first and second segment groups is defined by a respective start 
time and a respective segment duration. 

34. (Currently amended) A method implemented by an apparatus for processing 
multimedia data, the method comprising: 

generating segment information about an audio-visual program, the segment 
information identifying a plurality of audio-visual segments in the audio-visual program, 
wherein each audio-visual segment is defined by a temporal position in a multimedia stream 
of the audio-visual program and represents a continuous temporal content portion in the 
audio-visual program; 

generating segment group information for a hierarchical data structure d e scribing 
multim e dia data configured to facilitate browsing content in the audio-visual program ; and 

transmitting said segment information and said segment group information to a client, 
. wherein said segment group information: 
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defines first and second segment groups, each of which includes defines a 
respective plurality set of audio-visual segments selected from the plurality of audio-visual 
segments identified by the segment information in the [rail multimedia stream of the audio- 
visual program : 

specifies a respective group type and a respective duration for each of said 
first and second segment groups , the respective group types indicating that the first and 
second segment groups represent respective first and second content summaries related to 
objects or events as depicted in the audio-visual program ; and 

includes segment order information defining that (i) the audio-visual segments 
within the first segment group are ordered relative to each other according to a time sequence 
that is significant for the first content summary's representation of the corresponding events 
or objects in the audio-visual program and (ii) the audio-visual segments within the second 
segment group are unord e r e d not ordered relative to each other according to [[the]] any time 
sequence that is significant for the second content summary's representation of the 
corresponding events or objects in the audio-visual program . 

35. (Previously presented) The method of claim 34, wherein said segment group 
information includes a level information. 

36. (Previously presented) The method of claim 35, wherein said level 
information defines multiple levels. 

37. (Currently amended) The method of claim 34, wherein the segment group 
information defines a respective start time and a respective segment duration for each audio- 
visual segment contained in the first and second segment groups. 



38. 



(Currently amended) An apparatus for processing multimedia data, the 
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apparatus comprising: 
a memory; and 

a processor configured to perform operations comprising: 

receiving segment information about an audio-visual program, the segment 
information identifying a plurality of audio-visual segments in the audio-visual program, 
wherein each audio- visual segment is defined by a temporal position in a multimedia stream 
of the audio-visual program and represents a continuous temporal content portion in the 
audio-visual program; 

receiving segment group information defining first and second segment 
groups in a hierarchical data structure d e scribing multim e dia data configured to facilitate 
browsing content in the audio-visual program , each of the first and second segment groups 
including defining a respective plurality set of audio-visual segments selected from the 
plurality of audio-visual segments identified by the segment information in the [[a]] 
multimedia stream of the audio-visual program , wherein said segment group information 
specifies a respective group type and a respective duration for each of said first and second 
segment groups , the respective group types indicating that the first and second segment 
groups represent respective first and second content summaries related to objects or events as 
depicted in the audio-visual program, and wherein the segment group information includes 
segment order information defining that (i) the audio-visual segments within the first 
segment group are ordered relative to each other according to a time sequence that is 
significant for the first content summary's representation of the corresponding events or 
objects in the audio-visual program and (ii) the audio-visual segments within the second 
segment group are unord e r e d not ordered relative to each other according to [[the]] any time 
sequence that is significant for the second content summary's representation of the 
corresponding events or objects in the audio-visual program ; and 

storing the hierarchical data structure including the segment information along 
with the segment group information in the memory. 

39. (Previously presented) The apparatus of claim 38, wherein said segment 
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group information includes a level information. 

40. (Previously presented) The apparatus of claim 39, wherein said level 
information defines multiple levels. 

41. (Currently amended) The apparatus of claim 38, wherein each audio-visual 
segment contained in the first and second segment groups is defined by a respective start 
time and a respective segment duration. 

42. (Currently amended) A method implemented by an apparatus for processing 
multimedia data, the method comprising: 

receiving segment information about an audio-visual program, the segment 
information identifying a plurality of audio-visual segments in the audio-visual program, 
wherein each audio-visual segment is defined by a temporal position in a multimedia stream 
of the audio-visual program and represents a continuous temporal content portion in the 
audio-visual program: 

receiving segment group information from a provider; and 

storing said received segment information and said segment group information in a 
hierarchical data structure d e scribing multim e dia data configured to facilitate browsing 
content in the audio-visual program in a client, wherein said segment group information: 

defines first and second segment groups, each of which includ e s defines a 
respective plurality set of audio-visual segments selected from the plurality of audio-visual 
segments identified by the segment information in the [|"a]] multimedia stream of the audio- 
visual program ; 

specifies a respective group type and a respective duration for each of said 
first and second segment groups , the respective group types indicating that the first and 
second segment groups represent respective first and second content summaries related to 
objects or events as depicted in the audio-visual program : and 



Atty. Docket No.: 24286/81551 

7 

includes segment order information defining that (ilthe audio-visual segments 
within the first segment group are ordered relative to each other according to a time sequence 
that is significant for the first content simimarv's representation of the corresponding events 
or objects in the audio-visual program and (ii) t he audio-visual segments within the second 
segment group are unord e r e d not ordered relative to each other according to [[the]] aiiy time 
sequence that is significant for the second content summary's representation of the 
corresponding events or objects in the audio- visual program . 

43. (Previously presented) The method of claim 42, wherein said segment group 
information includes a level information. 

44. (Previously presented) The method of claim 43, wherein said level 
information defines multiple levels. 

45. (Previously presented) The method of claim 42, wherein each audio-visual 
segment contained in the first and second segment groups is defined by a respective start 
time and a respective segment duration. 

46. (Currently amended) A storage medium storing a hierarchical data structure 
describing multim e dia data, th e data structur e configured to be processed by multimedia data 
processing apparatus to facilitate browsing content in an audio-visual program , the stored 
data structure comprising: 

segment information about the audio-visual program, the segment information 
identifying a plurality of audio-visual segments in the audio-visual program, wherein each 
audio-visual segment is defined by a temporal position in a multimedia stream of the audio- 
visual program and represents a continuous temporal content portion in the audio-visual 
program: 
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segment group information defining first and second segment groups, each of which 
includ e s defines a respective plurality set of audio-visual segments selected from the 
plurality of audio-visual segments identified by the segment information in the [[a]] 
multimedia stream of the audio-visual program , wherein said segment group information 
specifies a respective group type and a respective duration for each of said first and second 
segment groups , the respective group types indicating that the first and second segment 
groups represent respective first and second content summaries related to objects or events as 
depicted in the audio-visual program , and wherein the segment group information includes 
segment order information defining that (i) the audio-visual segments within the first 
segment group are ordered relative to each other according to a time sequence that is 
significant for the first content summary's representation of the corresponding events or 
objects in the audio-visual program and (ii) the audio-visual segments within the second 
segment group are unord e r e d not ordered relative to each other according to [[the]] any time 
sequence that is significant for the second content summary's representation of the 
corresponding events or objects in the audio-visual program . 

47. (Previously presented) The storage medium of claim 46, wherein said 
segment group information includes a level information. 

48. (Previously presented) The storage medium of claim 47, wherein said level 
information defines multiple levels. 

49. (Currently amended) The storage medium of claim 46, wherein the segment 
group information defines a respective start time and a respective segment duration for each 
audio- visual segment contained in the first and second segment groups. 



50-53. (Cancelled) 
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54. (Currently amended) The apparatus of claim 30, wherein the respective group 
types for e ach of the first and second segment groups sp e cifi e s specify that the first and 
second segment groups are related to at least two obj e cts characters represented in the 
content of the multimedia stream. 

55. (Currently amended) The apparatus of claim 54, wherein the first segment 
group includes audio-visual segments representing time ordered relation changes between the 
at least two obj e cts characters . 

56. (Currently amended) The apparatus of claim 30, wherein the segment group 
information indicates that the first segment group includes audio-visual segments that 
represent highlights from the multimedia stream. 

57. (Currently amended) The apparatus of claim 54, wherein the audio-visual 
segments within the second segment group include audio-visual segments representing 
constant relations between the at least two obj e ct s characters . 



